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DATA STRUCTURE FOR EFFICIENT ENQUEUING AND DEQUEUING 

RELATED APPLICATION 

This application claims priority to and the benefit of the provisional patent 
application entitled "A Method to Enqueue and Dequeue from a Priority Queue 
5 Efficiently," filed on May 15, 2000, and assigned serial no. 60/204,221 . 

FIELD OF THE INVENTION 

This invention generally relates to ranked entities, and more particularly to ranked 
entities that are prioritized threads. 

BACKGROUND OF THE INVENTION 

10 Computer programs are commonly made up of a number of threads that are run 

within an operating system. Each thread typically has a priority within a range of priority 
levels. This enables the operating system to determine which threads should have greater 
priority when a number of different threads are asking to be executed at the same time. 
Operating systems, depending on their design, can have a large number of different 

1 5 priority levels. For example, some operating systems may have only eight priority levels, 
while others may have 256 priority levels. 

Real-time operating systems are those that guarantee execution of instructions 
within some predetermined, worst-case time limit, or bound. Because of this bound, real- 
time operating systems desirably must be able to enqueue prioritized threads to and 

20 dequeue prioritized threads from a priority queue that tracks all the threads within a 

predetermined maximum worst case limit. This is difficult to accomplish for a real-time 
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operating system that has a large number of priority levels, without affecting its 
predictable performance too greatly. For this and other reasons, there is a need for the 
present invention. 

SUMMARY OF THE INVENTION 

5 The invention relates to a data structure for efficiently ordering a number of 

ranked entities, including linking a new entity to and delinking an entity from the ranked 
entities. More particularly, the invention relates to enqueuing prioritized threads to and 
dequeuing prioritized threads from a priority queue. A data structure in one embodiment 
includes a horizontally linked hst, an array of a number of array entries, one or more 

1 0 vertically linked hsts, and a head pointer. 

The ranks of the entities are distributed over the array, such that each array entry 
has a corresponding range of ranks. Each array entry points to either null, or the entity 
having the greatest rank within that entry's range of ranks. The horizontally linked Ust 
links at least a subset of the ranked entities in a descending rank order direction, and 

1 5 optionally in an ascending rank order direction. Each entity in the horizontally linked list 
has a unique rank as compared to the ranks of the other entities in the horizontally Unked 
hst. Each vertically linked Ust links a subset of the number of entities having an identical 
rank in a first vertical direction and optionally in a second vertical direction. The head 
pointer points to the entity that has the greatest rank. 

20 hi the case of enqueuing prioritized threads to and dequeuing prioritized threads 

from a priority queue, the invention provides for efficient enqueuing and dequeuing with 
minimal impact on system performance, even where there are a large number of different 
priority levels. However, the invention is applicable to entities other than priorities for 
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threads. The invention specifically encompasses machine-readable media and methods 
of varying scope. Other aspects, embodiments and advantages of the invention, beyond 
those described here, will become apparent by reading the detailed description and by 
referencing the drawings. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagram showing a data structure according to an embodiment of the 
invention. 

FIG. 2 is a flowchart of a method showing how one embodiment removes an 
entity from the data structure of FIG. 1. 
10 FIG. 3 is a diagram of the data structure of FIG. 1 from which one of the entities 

has been removed, 

FIG. 4 is a flowchart of a method showing how one embodiment adds a new 
entity to the data structure of FIG. 1 . 

FIG. 5 is a diagram of the data structure of FIG. 1 to which new entities have been 

15 added. 

FIG. 6 is a diagram of an example computerized device that can be used to 
implement the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

In the following detailed description of exemplary embodiments of the invention, 
20 reference is made to the accompanying drawings that form a part hereof, and in which is 
shown by way of illustration specific exemplary embodiments in which the invention 
may be practiced. These embodiments are described in sufficient detail to enable those 
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skilled in the art to practice the invention. Other embodiments may be utiUzed, and 
logical, mechanical, electrical, and other changes may be made without departing from 
the spirit or scope of the present invention. The following detailed description is, 
therefore, not to be taken in a limiting sense, and the scope of the present invention is 
5 defined only by the appended claims. 

Data Structure 

FIG. 1 is a diagram showing a preferred data structure 100 of the invention. The 
data structure 100 efficiently orders a number of ranked entities by using an array 102. 
The ranked entities can be prioritized threads, and the array 102 can be a priority queue. 

1 0 The entities can also be software objects, components, nodes, or other constructs. The 
array 102 includes a number of array entries 104a, 104b, 104c, 104d, . . ., 104n. The rank 
of each ranked entity is selected from a number of ranks, which can be thread priorities. 
For example, there can be 256 ranks, where rank 1 can be considered a greater rank than 
rank 256. Alternatively, rank 256 can be considered greater than rank 1 . The ranks are 

15 distributed over the array entries 104 of the array 102, such that each array entry has a 
corresponding rank range. The rank distribution can be equal or unequal. For example, 
where there are eight array entries 104, each array entry can correspond to 32 ranks in an 
equal distribution over the array entries 104. The first array entry would correspond to 
ranks and have a rank range of 1-32, the second entry would correspond to ranks and 

20 have a rank range of 33-64, and so on. 

An example is used where there are 20 ranks, distributed equally over five array 
entries 104a, 104b, 104c, 104d, and 104n. Array entry 104a corresponds to ranks 1-4, 
array entry 104b corresponds to ranks 5-8, entry 104c corresponds to ranks 9-12, entry 
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104d to ranks 13-16, and entry 104n to ranks 17-20. Each array entry points to one of the 
entities that have the greatest rank within the rank range for the array entry. Where there 
is no such entity, the array entry points to null. This corresponds to the situation where 
there is no entity having a rank within the rank range for the array entity. Array entry 
5 104a points to the entity 108, which has a rank of 2. There are no entities with a rank 
between 5 and 8, so the array entry 104b points to null, as indicated by the arrow 116, 
The array entry 104c points to the entity 118, which has a rank of 1 1. The array entry 
104d points to the entity 120, which has a rank of 13. There are no entities with a rank 
between 17 and 20, so the array entry 104n points to null, as indicated by the arrow 132, 

10 The data structure 100 includes a horizontally linked list 103. The horizontally 

linked list 103 links a ranked entity for each of the different ranks of all the ranked 
entities. The ranked entities linked by horizontally hnked list 103 thus each have a 
unique rank as compared to the ranks of the other entities Unked by the list 103. For 
example, the horizontally linked hst 103 links entities 108, 114, 118, 120, 122, and 130, 

15 which have ranks 2, 4, 1 1, 13, 14, and 15, respectively. The horizontally linked Ust 103 
links the entities in a descending rank order, as indicated by the arrows 105. The 
horizontally linked Hst 103 links the entities optionally in an ascending rank order, as 
indicated by the arrows 107. 

The data structure 100 can include one or more vertically linked lists, such as the 

20 vertically linked lists 109 and 111. Each vertically linked list links ranked entities that 
have the same rank. For example, the vertically linked list 109 links entities 108, 110, 
and 112, all of which have a rank of 2, Similarly, the vertically linked list 1 1 1 links 
entities 122, 124, 126, and 128, all of which have a rank of 14. Each vertically linked Ust 
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links the entities in a first vertical direction, as indicated by the arrows 113. Each 
vertically Unked list links the entities optionally in a second vertical direction, as 
indicated by the arrows 115. The data structure 100 also can include a head pointer 106 
that points to one of the entities having the greatest rank that is within the horizontally 
5 linked list 103. For example, the head pointer 106 points to the entity 108, which has a 
rank of 2. 

In summary, the data structure 100 uses the array 102 and the horizontally linked 
list 103 to efficiently order ranked entities. Where there are ranked entities that have 
equal rank, the data structure 100 also uses vertically linked hsts, such as the vertically 
10 linked lists 109 and 111. Between the horizontally linked hst 103, and the vertically 

Unked Usts 109 and 1 1 1, all of the ranked entities are linked into at least one of the linked 
Usts. The next two sections of the detailed description describe how embodiments of the 
invention add and remove ranked entities to and from the data structure 100. 

Removal of Ranked Entities 

1 5 FIG. 2 is a flowchart showing how one embodiment removes a particular ranked 

entity from the data structure 100 of FIG. 1. Where the entity is a prioritized thread, and 
the array 102 of FIG. 1 is a priority queue, the removal process of FIG, 2 can be referred 
to as dequeuing the prioritized thread from the priority queue. The method 200 first 
determines whether the particular entity is in a vertically linked hst, in 202. The 

20 vertically Hnked hst can be the vertically linked list 109 or the vertically Hnked hst 1 1 1 of 
FIG. 1 . If the particular entity is in a vertically hnked hst, it is delinked from the list. 
This is accompUshed in the vertical directions 113 and 115. In the vertical direction 113, 
the entity that currently points to the particular entity is repointed to the entity to which 
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the particular entity points. Similarly, in the vertical direction 115, the entity that 
currently points to the particular entity is repointed to the entity to which the particular 
entity points. The pointers originating from the particular entity are then removed. 

For example, if the entity 108 of FIG. 1 were removed from the vertically linked 
5 list 109, in the vertical direction 113, the entity 112 would be repointed to the entity 110. 
In the vertical direction 115, the entity 110 would be repointed to point to the entity 112. 
The pointers originating from the entity 108 in both the directions 113 and 115 would be 
removed. FIG. 3 is a diagram showing the data structure 100 of FIG. 1 with the entity 
108 removed, where the data structure 100 is now indicated as the data structure 100' to 
10 signify the removal of the entity 108. With respect to the vertically linked list 109 of 
FIG. 1, now indicated as the list 109', the entity 112 now points to the entity 1 10 in the 
vertical direction 113, and the entity 110 now points to the entity 1 12 in the vertical 
direction 115. 

Referring back to FIG. 2, in 204, the method 200 determines whether the 
1 5 particular entity being removed is in the horizontally linked list. The horizontally hnked 
Ust can be the horizontally linked list 103 of FIG. 1 . If the particular entity is in the 
horizontally linked list, it is delinked from the list. This is accomplished in the 
descending rank order direction 105 and the ascending rank order direction 107. In the 
descending rank order direction 105, the entity that currently points to the particular 
20 entity is repointed to the entity to which the particular entity points. Similarly, in the 

ascending rank order direction 107, the entity that currently points to the particular entity 
is repointed to the entity to which the particular entity points. The pointers originating 
from the particular entity are then removed. 



7 



For example, if the entity 108 of FIG. 1 were removed from the horizontally 
linked list 103, no repointing would be necessary in the descending rank order direction 
105 because the entity 108 is the first entity in the hst 103 in this direction. Similarly, in 
the ascending rank order direction 107, no repointing would be necessary because the 

5 entity 108 is the last entity in the list 103 in this direction. However, the pointers 

originating from and pointing to the entity 108 in both the directions 105 and 107 would 
be removed. FIG. 3 shows the data structure 100 of FIG. 1 with the entity 108 removed. 
With respect to the horizontally linked list 103 of FIG. 1, now indicated as the list 103', 
the entity 108 is no longer present in the list 103.' 

1 0 Referring back to FIG. 2, in 206, the method 200 determines whether the 

particular entity to be removed is pointed to by an array entry. The array entry can be 
one of the array entries 104 of the array 102 of FIG. 1. If the particular entity is pointed 
to by an array entry, the array entry is adjusted to point to another entity, or to null. If the 
particular entity was removed from a vertically Unked Hst in 202, then the array entry is 

1 5 adjusted to point to the next entity in the list. That is, the array entry is adjusted to point 
to the entity to which the particular entity had pointed in the first vertical direction 113. 

If the particular entry was not removed from a vertically linked Ust in 202, but 
was removed from the horizontally linked Ust in 204, then the array entry is adjusted to 
point to the next entity in the Ust, if the next entity has a rank within the rank range for 

20 the array entry. That is, the array entry is adjusted to point to the entity to which the 
particular entity had pointed to in the descending rank direction 105, if this entity has a 
rank within the rank range for the array entry. If the particular entity was not removed 
from a vertically linked list in 202, or was not removed from the horizontally linked list 
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in 204, then the array entry is adjusted to point to null. Similarly, if the particular entity 
was removed from the horizontally linked list in 204, but the next entity in the list does 
not have a rank within the range for the array entry, then the array entry is adjusted to 
point to null. 

5 For example, if the entity 108 of FIG. 1 were removed, then the array entry 104a 

would be adjusted to point to another entity. Because the entity 108 is in the vertically 
linked Ust 109, the array entry 104a would be adjusted to point to the next entity in the 
vertically linked Ust 109 in the vertical direction 113, which is the entity 1 10, If the 
entity 108 were not in the vertically hnked list 109, the array entry 104a would be 

10 adjusted to point to the next entity in the horizontally linked Ust 103 in the descending 
rank direction 105, which is the entity 114, This is the case where the entities 110 and 
1 12 are not present, such that there is no vertically linked list 109. Note that the entity 
1 14 has a rank within the rank range for the array entry 104a. If the entity were not in the 
vertically linked Ust 109, and the entity 1 14 had earUer been removed, such that the entity 

15 1 1 8 is the next entity within the horizontally linked list 1 03, the array entry 1 04a would 
be adjusted to point to null. This is because the entity 1 18 has a rank that is not within 
the rank range for the array entry 104a. FIG. 3 shows the data structure 100 of FIG. 1 
with the entity 108 removed. With respect to the array entry 104a, it now points to the 
entity 110. 

20 Referring back to FIG. 2, in 208, the method 200 determines whether the 

particular entity being removed is pointed to by the head pointer. The header pointer can 
be the head pointer 106 of FIG. 1. If the particular entity is pointed to by the head 
pointer, the head pointer is adjusted to point to another entity, assuming that the particular 
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entity is not the last entity. If the particular entity was removed from a vertically linked 
list in 202, then the head pointer is adjusted to point to the next entity in the Ust. That is, 
the head pointer is adjusted to point to the entity to which the particular entity had 
pointed in the first vertical direction 113. If the particular entry was not removed from a 
5 vertically linked list in 202, but was removed from the horizontally linked Ust in 204, 
then the head pointer is adjusted to point to the next entity in the list. That is, the head 
pointer is adjusted to point to the entity to which the particular entity had pointed to in the 
descending rank direction 105. 

For example, if the entity 108 of FIG. 1 were removed, then the head pointer 106 

1 0 would be adjusted to point to another entity. Because the entity 1 08 is in the vertically 
linked list 109, the head pointer 106 would be adjusted to point to the next entity in the 
vertically linked list 109 in the vertical direction 1 13, which is the entity 1 10. If the 
entity 108 were not in the vertically Unked hst 109, the head pointer 106 would be 
adjusted to point to the next entity in the horizontally hnked list 103 in the descending 

15 rank direction 105, which is the entity 114. This is the case where the entities 110 and 
1 12 are not present, such that there is no vertically linked list 109. FIG. 3 shows the data 
structure 100 of FIG. 1 with the entity 108 removed. With respect to the head pointer 
106, it now points to the entity 110. 

Addition of Ranked Entities 

20 FIG. 4 is a flowchart showing how one embodiment adds a new ranked entity to 

the data structure 100 of FIG. 1. Where the new entity is a prioritized thread, and the 
array 102 of FIG. 1 is a priority queue, the addition process of FIG. 4 can be referred to 
as enqueuing the prioritized thread to the priority queue. The method 400 first 
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determines the appropriate array entry for the new entity, in 402. This array entry has a 
rank range encompassing the rank of the new entity. The array entry can be one of the 
array entries 104 of the array 102 of FIG. 1. If the array entry currently points to null, 
then the method 400 proceeds from 404 to 406, where the array entry is adjusted to point 
5 to the new entity. In 40 8, the method 400 adjusts the head pointer if necessary. The head 
pointer can be the head pointer 106 of FIG. 1. If the rank of the new entity is greater than 
the rank of the entity currently pointed to by the head pointer 106, then the head pointer is 
adjusted to point to the new entity instead. 

If the array entry does not currently point to null, then the method proceeds to 410 

1 0 from 404 instead of to 406. If the new entity has a rank greater than the rank of the entity 
currently pointed to by the array entry, referred to as the first entity in FIG. 4, then the 
method 400 again proceeds to 406, and then to 408, as has been described. Otherwise, 
the method proceeds to 412. If the new entity has a rank equal to the rank of any other 
entity, then the method 400 proceeds from 412 to 414, where the new entity is linked into 

15 a vertically linked list. The vertically linked list can be the vertically linked hst 109 or 
the vertically linked list 1 1 1 of FIG. 1, or a new vertically linked list. The new entity 
becomes the new last entity in the vertically linked list. 

If there already is a vertically linked list into which the new entity is to be linked, 
then the new entity is adjusted in the vertical direction 1 13 to point to the first entity in 

20 the list. The new entity is also adjusted in the vertical direction 1 15 to point to the former 
last entity in the list. The first entity in the list is adjusted to point to the new entity in the 
vertical direction 115, because the new entity is now the last entity in the Ust. The former 
last entity in the list is adjusted to point to the new entity in the vertical direction 113. If 
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there is not already a vertically linked list into which the new entity is to be linked, then 
the new entity is the second and the last entity in a new vertically linked list. The first 
entity in the list is the other entity that has the same rank as the new entity. The first 
entity is adjusted to point to the new entity in the vertical directions 1 13 and 1 15, and the 

5 new entity is adjusted to point to the new entity in the vertical directions 113 and 115. 

Still referring to FIG. 4, if the new entity has a rank that is not equal to the rank of 
any other entity, then the method 400 proceeds from 412 to 416, where the new entity is 
linked into the horizontally linked list. The horizontally linked list can be the 
horizontally linked hst 103 of FIG. L The method 400 also proceeds to 416 from 408. 

10 The method proceeds to 416 from either 412 or 408 because the new entity has a unique 
rank as compared to the ranks of the other entities already in the horizontally linked list. 
There are three cases in 416. The new entity may have a rank greater than the rank of 
every other entity, in which case the new entity is added to the horizontally linked list at 
the front, and is the new front entity. The new entity may have a rank less than the rank 

1 5 of every other entity, in which case the new entity is appended to the horizontally hnked 
list at the end, and is the new back entity. The new entity may have a rank that is neither 
greater than nor less than the rank of every other entity, in which case new entity is 
inserted within the list. The new entity is inserted within the list such that the rank of a 
first entity to the left of the new entity is less than the rank of the new entity, which is less 

20 than the rank of a second entity to the right of the new entity. 

With respect to this last case, prior to insertion of the new entity within the 
horizontally hnked Hst, the first entity identified in the previous paragraph points to the 
second entity in the descending rank order direction 105. Similarly, the second entity 
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identified in the previous paragraph points to the first entity in the ascending rank order 
direction 107. After insertion, in the descending rank order direction 105, the first entity 
points to the new entity, which points to the second entity. Similarly, in the ascending 
rank order direction 107, the second entity points to the new entity, which points to the 

5 first entity. Where the new entity has a rank greater than the rank of every other entity, 
and is added to the horizontally linked Ust at the front, the new entity points to the old 
front entity in the descending rank order direction 105. The old front entity points to the 
new entity in the ascending rank order direction 107. Where the new entity has a rank 
less than the rank of every other entity, and is appended to the horizontally linked Hst at 

10 the end, the new entity points to the old back entity in the ascending rank order direction 
107. The old back entity points to the new entity in the descending rank order direction 
105. 

As an example of adding entities to vertically and horizontally linked lists, FIG. 5 
is a diagram showing the data structure 100 of FIG. 1 with new entities 513, 515, and 517 

15 added. The data structure 100 is indicated in FIG. 5 as the data structure 100" to signify 
the addition of these new entities. The new entities 515 and 517 have specifically been 
added to vertically linked lists, while the new entity 513 has been added to a horizontally 
linked list. The new entity 517 is added to the already existing vertically linked list 109 
of FIG. 1, now indicated as the Ust 109". The new entity 515 is added to the new 

20 vertically linked list 519. The new entity 513 is added to the horizontally linked list 103, 
now indicated as the Ust 1 03". The new entity 5 17 has a rank of 1 , which is the same 
rank as the other entities in the list 109". Similarly, the new entity 515 has a rank of 4, 
which is the same rank as the other entity in the Ust 519, the entity 1 14. The new entity 
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513 has a rank of 3, which is between the rank of 2 of the entity 108 and the rank of 4 of 
the entity 114. 

With respect to the new entity 517, the new entity 517 points to the first entity in 
the Ust 109", which is the entity 108, in the vertical direction 113. The new entity 517 

5 points to the former last entity, which is the entity 1 12, in the vertical direction 115, The 
entity 108 now points to the new entity 517 in the vertical direction 115. The entity 112 
now points to the new entity 5 17 in the vertical direction 113. With respect to the new 
entity 515, the new entity 515 points to the first entry in the list 519, which is the entity 
1 14, in both the vertical directions 1 13 and 1 15. Similarly, the entity 1 14 points to the 

1 0 new entity 5 1 5 in both the vertical directions 1 1 3 and 115. With respect to the new entity 
513, the entity 108 now points to the new entity 513 in the descending rank order 
direction 105, and the new entity 513 points to the entity 1 14 in the descending rank 
order direction 105. The entity 114 now points to the new entity 513 in the ascending 
rank order direction 107, and the new entity 513 points to the entity 108 in the ascending 

1 5 rank order direction 1 07. 

Example Computerized Device 

The invention can be implemented within a computerized environment having 
one or more computerized devices. The diagram of FIG. 6 shows an example 
computerized device 600. The example computerized device 600 can be, for example, a 
20 desktop computer, a laptop computer, or a personal digital assistant (PDA). The 

invention maybe practiced with other computer system configurations as well, including 
multiprocessor systems, microprocessor-based or programmable consumer electronics, 
network computers, minicomputers, and mainframe computers. The invention may be 
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practiced in distributed computing environments where tasks are performed by remote 
processing devices that are linked through a communications network. 

The device 600 includes one or more of the following components: processor(s) 
602, memory 604, storage 606, a communications component 608, input device(s) 610, a 
5 display 612, and output device(s) 614, For a particular instantiation of the device 600, 
one or more of these components may not be present. For example, a PDA may not have 
any output device(s) 614. The description of the device 600 is to be used as an overview 
of the types of components that typically reside within such a device, and is not meant as 
a limiting or exhaustive description. 

10 The processor(s) 602 may include a single central-processing unit (CPU), or a 

plurality of processing units, commonly referred to as a parallel processing environment. 
The memory 604 may include read-only memory (ROM) and/or random-access memory 
(RAM). The storage 606 may be any type of storage, such as fixed-media storage 
devices and removable-media storage devices. Examples of the former include hard disk 

15 drives, and flash or other non-volatile memory. Examples of the latter include tape 

drives, optical drives like CD-ROM drives, and floppy disk drives. The storage devices 
and their associated machine-readable media provide non- volatile storage of machine- 
readable instructions, data structures, program modules, and other data. Any type of 
machine-readable media that can store data and that is accessible by a computer can be 

20 used. 

The device 600 may operate in a network environment. Examples of networks 
include the Internet, intranets, extranets, local-area networks (LAN's), and wide-area 
networks (WAN's). The device 600 may include a communications component 608, 
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which can be present in or attached to the device 600. The component 608 may be one or 
more of a network card, an Ethernet card, an analog modem, a cable modem, a digital 
subscriber loop (DSL) modem, and an hitegrated Services Digital Network (ISDN) 
adapter. The input device(s) 610 are the mechanisms by which a user provides input to 

5 the device 600. Such device(s) 610 can include keyboards, pointing devices, 

microphones, joysticks, game pads, and scanners. The display 612 is how the device 600 
typically shows output to the user. The display 612 can include cathode-ray tube (CRT) 
display devices and flat-panel display (FPD) display devices. The device 600 may 
provide output to the user via other output device(s) 614. The output device(s) 614 can 

10 include speakers, printers, and other types of devices. 

The methods that have been described can be computer-implemented on the 
device 600. A computer-implemented method is desirably reaUzed at least in part as one 
or more programs running on a computer. The programs can be executed from a 
machine-readable medium such as a memory by a processor of a computer. The 

15 programs are desirably storable on a machine-readable medium, such as a floppy disk or 
a CD-ROM, for distribution and installation and execution on another computer. The 
program or programs can be a part of a computer system, a computer, or a computerized 
device. Furthermore, data structures as have been described can be stored on a machine- 
readable medium. 

20 Conclusion 

It is noted that, although specific embodiments have been illustrated and 
described herein, it will be appreciated by those of ordinary skill in the art that any 
arrangement that is calculated to achieve the same purpose may be substituted for the 
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specific embodiments shown. This apphcation is intended to cover any adaptations or 
variations of the present invention. Therefore, it is manifestly intended that this invention 
be limited only by the claims and equivalents thereof 
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I claim: 

1 . A machine-readable medium having a data stracture stored thereon for efficiently 
ordering a pluraUty of entities, each entity having a rank within a plurality of ranks, the 
data structure comprising: 

5 a horizontally linked hst linking at least a subset of the pluraUty of entities in at least 

a descending rank order direction, each entity in the horizontally linked hst having a 
unique rank as compared to the ranks of other entities in the horizontally linked Ust; and, 

an array having a plurality of array entries over which the plurality of ranks are 
distributed such that each array entry has a corresponding range of ranks, at least one 
10 array entry each pointing to an entity of the plurality of entities having a greatest rank 
within the corresponding range of ranks for the array entry, 

2. The medium of claim 1, the data structure further comprising at least one vertically 
linked Hst, each vertically linked Ust linking in at least one direction a corresponding 
subset of the pluraUty of entities having an identical rank. 

15 3 . The medium of claim 2, wherein each vertically Unked Ust links the corresponding 
subset of the plurality of entities in a first vertical direction and a second vertical 
direction. 

4. The medium of claim 1, the data structure further comprising a head pointer pointing 
to an entity having a greatest rank of the plurality of ranks of the pluraUty of entities. 
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5. The medium of claim 1, wherein the horizontally linked Ust further links at least the 
subset of the plurality of entities in an ascending rank order direction. 

6. The medium of claim 1 , wherein the plurality of ranks are equally distributed over the 
plurality of array entries. 

5 7. The medium of claim 1 , wherein the entity having the greatest rank within the 

corresponding range of ranks for each of one or more of the at least one array entry is one 
of a subset of the plurality of entities having the greatest rank within the corresponding 
range of ranks for the array entry. 

8. The medium of claim 1, wherein at least one array entry of the plurality of array 
1 0 entries each points to null, corresponding to no entity within the plurality of entities 

having a rank within the corresponding range of ranks for the array entry. 

9. The medium of claim 1, wherein each entity of the plurality of entities is a thread, the 
rank of the entity is a priority for the thread, and the array is a priority queue. 

10. A method for removing a particular entity from a plurality of entities, each entity 
1 5 having a rank within a plurality of ranks, the method comprising: 

in response to determining that the particular entity is present within a vertically 
linked list linking in at least one direction a corresponding subset of the plurality of 
entities having an identical rank, the corresponding subset including the particular entity, 
delinking the particular entity from the vertically linked list; 
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in response to determining that the particular entity is present within a horizontally 
linked list linking at least a subset of the plurahty of entities in at least in a descending 
rank order direction, the subset including the particular entity, delinking the particular 
entity from the horizontally linked list; and, 
5 in response to determining that an array entry of a plurality of array entries of an array 

over which the plurality of ranks are distributed points to the particular entity, adjusting 
the array entry to point to one of null and another one of the plurality of entities. 

11. The method of claim 10, wherein the array entry has a corresponding range of ranks, 
and adjusting the array entry to point to one of null and another one of the plurality of 

10 entities comprises, in response to determining that the particular entity was present within 
the vertically linked list, adjusting the array entry to point to a next entity within the 
vertically linked list. 

12. The method of claim 11, wherein adjusting the array entry to point to one of null and 
another one of the plurahty of entries further comprises, otherwise, in response to 

15 determining that the particular entity was present within the horizontally linked list, and 
that the rank of a next entity within the horizontally linked list is within the 
corresponding range of ranks for the array entry, adjusting the array entry to point to the 
next entity within the horizontally linked list. 

13. The method of claim 12, wherein adjusting the array entry to point to one of null and 
20 another one of the plurality of entries further comprises, otherwise, adjusting the array 

entry to point to null. 
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14, The method of claim 10, further comprising, in response to determining that a head 
pointer pointing to an entity having a greatest rank of the plurahty of ranks of the 
pluraUty of entities points to the particular entity, adjusting the head pointer to point to 
another one of the plurality of entities. 

5 15. The method of claim 1 4, wherein adjusting the head pointer to point to another one of 
the plurality of entities comprises, in response to determining that the particular entity 
was present within the vertically linked list, adjusting the head pointer to point to a next 
entity with the vertically linked hst. 

16. The method of claim 15, wherein adjusting the head pointer to point to another one of 
10 the plurality of entities comprises, otherwise, in response to determining that the 

particular entity was present within the horizontally linked hst, adjusting the head pointer 
to point to a next entity within the horizontally linked list. 

17. The method of claim 10, wherein each entity of the plurality of entities is a thread, the 
rank of the entity is a priority for the thread, and the array is a priority queue. 

15 18. The method of claim 1 0, wherein the method is performed by execution of a 
computer program stored on a machine-readable medium by a processor. 

19. A method for adding a new entity having a rank within a plurality of ranks to a 
pluraUty of entities also each having a rank within the plurality of ranks, the method 
comprising: 
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of a plurality of array entries of an array over which the pluraUty of ranks are 
distributed such that each array entry has a corresponding range of ranks, determining the 
array entry having the corresponding range of ranks in which the rank of the new entity 
lies; 

5 adjusting the array entry having the corresponding range of ranks into which the rank 

of the new entity lies to point to the new entity in response to determining that the array 
entry currently points to null; 

adjusting the array entry having the corresponding range of ranks into which the rank 
of the new entity lies to point to the new entity in response to determining that the array 

10 entry current points to an entity having a rank less than the rank of the new entity; 

linking the new entity into a vertically linked hst linking in at least one direction a 
corresponding subset of the pluraUty of entities having an identical rank, in response to 
determining that the rank of the new entity is equal to the rank of any other entity within 
the plurality of entities; and, 

15 otherwise, linking the new entity into a horizontally Unked list linking at least a 

subset of the plurality of entities in at least a descending rank order direction, each entity 
in the horizontally linked hst having a unique rank as compared to the ranks of other 
entities in the horizontally Unked list. 

20. The method of claim 19, further comprising adjusting a head pointer pointing to an 
20 entity having a greatest rank of the plurality of ranks of the plurality of entities to point to 
the new entity in response to determining that the rank of the new entity is greater than 
the rank of the entity of the plurality of entities to which the head pointer currently points. 
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21. The method of claim 19, wherein each entity of the pluraUty of entities is a thread, the 
rank of the entity is a priority for the thread, and the array is a priority queue. 

22. The method of claim 19, wherein the method is performed by execution of a 
computer program stored on a machine-readable medium by a processor. 
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ABSTRACT OF THE DISCLOSURE 

A data structure for efficient enqueuing and dequeuing is disclosed. The structure 
includes a horizontally linked list, an array, a vertically linked list, and a head pointer. 
Entity ranks are distributed over the array, where each array entry has a range of ranks. 

5 Each array entry points to null or the entity having the greatest rank within that entry's 
range. The horizontally linked list Unks at least a subset of ranked entities. Each entity 
in the linked list has a unique rank as compared to the ranks of the other entities in the 
hst. Each vertically linked Ust links a subset of entities having an identical rank. The 
head pointer points to the entity that has the greatest rank. Methods for adding entities to 

10 and removing entities from the data structure are also disclosed. The invention can be 
used to enqueue threads to and dequeue threads from a priority queue. 
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